UNCLASSIFIED 


BIMEASURES  AND  SAMPLING  THEOREMS  FOR  UEAKLV 
HARMON  I ZABLE  PROCESSES'^)  CALIFORNIA  UNIV  RIVERSIDE 
DEPT  OF  MATHEMATICS  D  K  CHANG  ET  AL.  27  SEP  82  TR-7 
N00014-79-C-0754  F/G  12/1 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  tUNCAU  Of  STANOAftDS A 


UNIVERSITY  OF  CALIFORNIA 

DEPARTMENT  OF  MATHEMATICS 

RIVERSIDE,  CALIFORNIA  92521 


This  document  has  been  approved 
for  public  release  and  sale;  its 
distribution  is  unlimited. 


g2  1 1  ui  'u9  4 


BIMEASURES  AND  SAMPLING 
THEOREMS  FOR  WEAKLY  HARMONIZABLE 
PROCESSES 

by 

Derek  K.  Chang  and  M.  M.  Rao 


Technical  Report  No.  7 
September  27,  1982 


BIMEASURES  AND  SAMPLING  THEOREMS  FOR 
WEAKLY  HARMONIZABLE  PROCESSES 


Derek  K.  Chang  and'  M.  M.  Rao 

Department  of  Mathematics 
University  of  California 
Riverside,  California  92521 


ABSTRACT 

If  (X(t),t€H}  is  a  weakly  harmonizable  process, 
conditions  on  the  process  are  found  in  order  that  X(t) 

CO 

=  E  a  (t)X(nn/a)  for  a  suitable  a  >0  and  coeffi- 

n*-®  “  2 

cients  an(c)  »  the  series  converging  in  L  (P)-tnean. 

Consequently  the  process  can  be  determined  by  sampling 
at  fixed  intervals  nh,  n  ■  0,±1,...  ,  h  ■  n/a>0  ,  A 
corresponding  result  is  also  obtained  for  a  more  general 
Cramer  class.  To  carry  out  this  analysis,  it  is  neces¬ 
sary  to  use  the  properties  of  bimeasures.  Some  aspects 
of  the  bimeasure  theory  and  its  distinction  from  the 
Lebesgue  theory  are  included.  This  is  used  essentially 
for  the  analysis  of  harmonizable  processes,  and  has  in¬ 
dependent  interest. 


I.  INTRODUCTION .  Let  (0,E,P)  be  a  probability  space 
and  Lq(P)  be  the  subspace  of  square  integrable  complex 
valued  random  variables  on  0  with  means  zero,  i.e., 
X€Lq (P)  iff  E(|X|2)<-  and  E(X)  -0  where  E(X)  - 
J^XdP  ,  the  expectation.  A  second  order  process 
{X(t),t€lR3  of  interest  in  this  paper  is  a  mapping  X:]R 
-  Lq(P)  and  let  rx(s,t)  -  E(X(s)X(t))  ,  rx(-,‘)  being 
the  covariance  function.  The  types  of  processes  con¬ 
sidered  here  are  classified  according  to  the  form  of 
the  covariance  function  r  of  X  .  The  process  is 
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said  to  be  strongly  (or  Loeve,  cf.  [8])  harmonizable  if 
r  admits  a  representation  as : 


rx(s,t)  »  J’]RJ,IleisX'it:X/Fx(dX,d\/) 


where  Fx:3RxR-*(C  is  a  positive  definite  function  of 
bounded  variation  in  the  plane,  and  the  integral  is  de¬ 
fined  in  the  standard  Lebesgue  sense.  Here  bounded  var¬ 
iation  is  understood  in  the  sense  of  Vitali  so  that  one 
has 

I F  {  (RxR)  i  supC  ?  ?  |F  (A.,B.)|  : 

x  i-ij-i  x  1  J 

<=  R,Bj  c  R  are  intervals}  <*  ,  (2) 

where  FfA.B)  denotes  the  increment,  for  A  ■  (a,b]  , 


(c  ,d]  ,  given  by 

Fx(A,B)  -  Fx(b,d)  -Fx(b,c)  -Fx(a,d)  +Fx(a,c)  . 
This  is  a  generalization  of  the  classical  notion  of 
(weak)  stationarity  since,  by  definition,  the  latter  is 
a  process  whose  covariance  r  (-,-)  is  continuous  and 
depends  only  on  the  difference  s  -  t  ("invariant"  co- 
variance  under  translations  of  the  time  axis  R  )  so 
that  r  (s,t)  ■  r  (s-t)  and  by  Bochner's  theorem  the 

X  X 

continuous  positive  definite  function  r  can  be 

X 

uniquely  expressed  as : 

fx(s-t)  -  ;Eel<s-t>XG!t(dX)  (3) 

for  a  positive  bounded  nondecreasing  function  G  . 


Thus  (1)  becomes  (3)  if 
nal  X  ■  X '  so  that  G, 


concentrates  on  the  diago¬ 


nal  X  «  x'  so  that  G„(X)  »  533'F„(X,X')  . 

o  X  A.A.  X 

If  T:Lq(P)  -Lq(P)  is  a  bounded  linear  mapping, 
and  (Xc,t€]R}  is  a  stationary  process,  then  in  some 
applications  it  is  desired  to  consider  the  transformed 
(e.g.,  filtered)  process  Yfc  ■  TXt,  t€3R  .  [Here  and 
below  Xc  *  X(t)  are  interchangeably  written,  for  con¬ 


venience  . ]  However 
For  instance,  if  T 


Y  is  not  stationary  in  most  cases 
is  a  projection  operator  with  a 


finite  dimensional  range,  then  the  CYt,t€]R}  is  strongly 
harmonizable  but  not  generally  stationary.  If  T  has 
an  infinite  dimensional  range  (but  T  +  identity),  then 
(Yc,t€]R}  is  generally  not  even  strongly  harmonizable. 

It  is  weakly  harmonizable  in  the  sense  that  its  covari¬ 
ance  function  r  :(s,t)  ►»  E(Y  Y  )  is  representable  as: 
y  sc 

ry(s,t)  -  ;KJVlsX'iu‘Fy(di,dx')  ,  S.csm,  (4) 

where  F^lRxR-C  is  a  positive  definite  function  with 
finite  Frechet  variation.  This  means : 

n  n 

!|F  H(lRxIl)  “  sup£  E  E  a^a  .F  (A^, A. ) :  |  a^  |  ^1  ,a^€<C , 
j  i-1  j  »1  J  J 

A^  cR  is  an  interval ,  i  * 

l,...,n}<-  .  (5) 

Evidently  i|Fyi|(]RxR)  *  |Fy|  (lRx]R)  s-  ,  usually  with  a 
strict  first  inequality  when  the  second  is  infinite. 

But  then  what  is  the  meaning  of  the  integral  in  (4)? 

This  is  generally  a  nonabsolute  (hence  not  a  Lebesgue) 
integral  and  is  taken  in  the  sense  of  Morse-Transue  [9]. 
Some  of  its  properties  are  essential  for  the  following 
work  and  hence  some  aspects  of  this  theory  of  bimeasures 
determined  by  such  F^  ,  called  the  spectral  measure  of 
the  process,  will  be  given  in  the  next  section.  Because 
of  its  use  in  other  studies  on  the  subject  and  because 
of  independent  interest,  the  work  presented  here  will 
be  somewhat  more  than  what  is  needed  for  our  present 
purposes.  It  is  useful  to  remark  that  if  CYt,t€]R}  is 
any  weakly  harmonizable  process  and  T  is  any  bounded 
linear  mapping,  then  (TYt,telR}  is  also  weakly  harmon¬ 
izable.  These  processes  are  particularly  suited  in  ap¬ 
plications  because  of  such  closure  properties.  Sec¬ 
tion  3  contains  a  description  of  these  processes,  and 
their  integral  representations.  Since  in  applications 
it  is  difficult  (or  expensive)  to  observe  a  process 


i 


(Yc,t€]R}  on  all  of  R  ,  one  often  wants  to  sample  it 
preferably  at  equidistant  points  nh,  n  ■  0,±1,±2,... 
and  get  a  good  approximation  to  the  whole  process  in 
such  a  way  that  there  is  no  ’’aliasing,"  so  that  two 
different  processes  shall  not  have  the  same  realizations 
at  these  points.  Reasonably  good  sufficient  conditions 
on  the  spectral  functions  are  obtained  in  order  that 
such  sampling  is  possible  for  weakly  harmonizable  pro¬ 
cesses  .  This  requires  a  different  technique  than  the 
strongly  harmonizable  case.  These  results  constitute 
Section  4.  Several  related  remarks  are  given  in  the 
last  section. 

It  will  be  seen  that,  once  the  representation  the¬ 
ory  is  embarked,  one  can  include  processes  more  general 
than  harmonizable  classes.  Such  a  generalization  was 
already  introduced  by  Cramer  [3],  Thus  a  process  Z:]R 
-  Lq(P)  is  said  to  be  of  Cramer  class,  if  the  covari¬ 
ance  function  rz  of  Z  can  be  expressed  as: 

rz(s,t)  -  (s ,\)lz  (t '  >FZ  (dX  ,dX ' )  ,  (6) 

where  F_  :!Rx3R-<C  is  positive  definite,  and  is  of  fi- 

z  2 
nite  Vitali  variation  on  each  finite  domain  of  R  , 

and  C  g_  (s ,  • )  ,s€]R}  is  a  class  of  Borel  functions  for 
z 

which  the  (Lebesgue)  integral  satisfies: 

VR8z(s»X)8z(s>X  :)FzCdX»dX/)  <->  s6]R  •  If  MS’X)  " 

expCisX.}  ,  and  F_  is  of  finite  variation  on  the  whole 
plane,  then  the  Cramdr  class  reduces  to  the  strongly 
harmonizable  case.  A  sampling  theorem  for  this  class 
is  also  obtained,  and  it  extends  an  earlier  result  of 
Piranashvili  [11] .  It  is  possible  to  extend  this  ma¬ 
terial  if  the  variations  here  are  replaced  by  Frdchet 
variations,  in  these  definitions.  The  existence  of  all 
these  processes  is  also  discussed  in  Section  3  below. 

Sampling  theorems  and  their  importance  have  been 
noted  in  information  and  engineering  applications.  An 
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early  general  and  precise  result  for  stationary  processes 
was  obtained  by  Lloyd  [7],  and  his  result  (the  suffi¬ 
ciency  part)  was  extended  in  [14]  for  strongly  harmoniz- 
able  processes,  and  another  extension  for  the  latter  can 
be  found  in  [11] .  The  type  of  sampling  theorems  given  r 

below  is  influenced  by  the  point  of  view  (but  not  the 
methods  which  do  not  extend)  of  [11]. 

For  a  smooth  sailing  later  on,  the  measure  aspects 
will  now  be  discussed  in  some  detail.-  However,  a  reader  r 

interested  in  seeing  the  stochastic  theory  immediately, 
and  is  willing  to  accept  (temporarily)  the  properties  of 
bimeasures,  can  now  go  directly  to  Sections  3-5. 

r 

II.  ASPECTS  OF  BIMEASURES  AND  THEIR  INTEGRALS.  A  start¬ 
ing  point  for  the  study  of  weakly  harmonizable  processes 
is  to  define  the  integral  in  (4).  This  will  emerge  from 
the  general  theory  of  C-bimeasures  developed  by  Morse  t 

and  Transue  [9]  but  now  their  general  study  has  to  be 
slightly  restricted.  To  see  what  is  precisely  needed, 
a  brief  account  of  this  development  will  be  presented 
here  since  it  is  not  available  in  the  existing  papers. 

It  will  supplement  [19]. 

Let  be  a  pair  of  locally  compact  spaces  and 

K(S^)  be  the  space  of  continuous  complex  functions  on 
with  compact  supports,  i  *  1,2  .  The  concept  of  a 
<E -bimeasure  of  [9]  is  as  follows:  * 

Definition  2.1.  A  complex  valued  bilinear  mapping  A 
on  the  product  space  ^(Sj^xK^)  *-s  a  <C -bimeasure  on 

SLxS2  if  A(*,v):K(S1)-«  and  A  (u,  • )  :X  (S2)  -  C  are 
relatively  bounded  linear  functionals  for  each  u€K(5^), 
v€K(S2)  .  [Relatively  bounded  A(-,v)  means  that  if 
K  c  is  compact  and  K (K)  c  K(S^)  is  considered, 
then  A ( • ,v) :K (K)  - C  is  bounded.] 

Since  each  such  relatively  bounded  functional  on  x(S^)  9 
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is  uniquely  representable  by  a  signed  Saire  measure  on 
,  by  the  classical  Riesz  representation  theorem  and 
then  such  a  measure  has  a  unique  extension  of  being  a 
Radon  measure  by  the  standard  theory  of  Bourbaki  [1] , 
one  refers  to  each  such  functional  itself  as  a  Radon  meas- 
ure,  as  is  done  in  [9].  Given  such  a  C-bimeasure  A  , 
one  defines  the  integral  of  [9]  as: 

Definition  2.2.  Let  f:S^~C,  g^"*®  be  Baire  func¬ 
tions  and  A  be  a  C-bimeasure  on  S^xS2  •  Then  (f,g) 
is  said  to  be  Morse-Transue  (or  MT- .  cf.  [9],  p.  482) 
integrable  if  (a)  f  is  A(*,v)-  and  g  is  A(u,*)“ 
integrable  for  each  u€K (S^) ,v€K CS2 )  (the  integrals  are 
denoted  A(*,v)(f)  and  A(u,*)(g)  ),  (b)  the  linear 
functionals  A  (•  ,g)  :u  •-  A  (u,  • )  (g) ,  A (f ,  • )  :v  ~  A  ( •  ,v)  (f ) 
are  Radon  measures,  and  (c)  the  integrals  A(f,-)(g) 
and  A ( • ,g) (f )  exist  and  are  equal.  This  common  value 
is  denoted  by 

A(f,g)  -  (MT);  j*  (f  ,g)dA  -  A  (f ,  •  )  (g)  -  A  ( •  ,g)  (f )  .  (7) 

S1  S2 

The  reason  for  condition  (b)  in  this  definition  is 
that  A  ( • , • )  should  be  definable  for  measurable  (f,g)  , 
not  merely  continuous  ones.  However,  as  a  consequence 
of  his  work  on  vector  measures,  Thomas  ([17],  p.  144) 
has  shown  that  this  is  actually  redundant ,  and  hence 
(a)  and  (c)  suffice  in  the  definition.  Although  the 
integrability  concept  of  (7)  is  needed  below,  the 
Bourbaki  point  of  view  of  integration  employed  is  some¬ 
what  inconvenient  for  our  work.  So  an  ensemble  point 
of  view,  due  to  Ylinen  [19],  will  now  be  presented  and 
the  results  will  be  compared  with  the  above. 

Let  (G^,T^),  i“l,2  ,  be  a  pair  of  measurable  spaces 
and  G  the  usual  complex  plane.  Then  a  mapping  3: 
^lx^2~*®  cerme<*  a  bimeasure  if  3(’,F)  and  3(E,0 


are  c-additive  for  each  E€E^  ,  and  F€E2  ,  respectively. 
The  Vitali  and  Frechet  variations  of  0  are  defined 
exactly  as  in  (2)  and  (5)  where  in  (5)  the  sum  now  is 
n  n 

replaced  by  |  £  E  a4S.  3  (A.,B.)|  for  disjoint  collec- 
i-1  j-1  1  2  1  J 

tions  CA^jJ.CBj of  from  classi¬ 

cal  theory  (cf.  [4],  IV. 10. 2)  that  ||@||  (0^ ,0^)  < ® 
always,  though  |0|  *-s  not  necessarily  finite. 

Clearly  ||0||  (A,B)  *  |  @  |  (A,B)  .  An  integral  relative  to 
0  is  introduced  as  follows : 


Definition  2.3.  Let  f^:fl^-*C,  i“l,2  ,  be  measurable 
functions  and  SrE^xX^-'C  be  a  bimeasure.  Then  (f^,f2) 
is  0-integrable  if  (a)  for  each  E€£^,F€£2  ,  is 
B(*,F)-  and  f2  is  0 (E, • )-integrable  inLebesgue's 
sense,  so  that  f  0  (Q-,  ,  •  )  :F  J*  f-.  (ui,  )0  (duu,  ,F)  is  a 
rl  L  Q1 


complex  measure  on  E2  and  similarly  0^  C-,^)  is  a 


complex  measure  on  E^  ,  and  (b)  f^  is  0^  (-,02)“fnte” 


grable  and  f2  is  ^  , • )-integrable  (in  the  Lebesgue 

sense)  and 


H  f1(<«1)0f  “  J  ^2^f  @^ni»du,2^  "  ^fl»f2 

2  ^2  1  0^  O2 


)d0  , 


(8) 


where  the  last  symbol  is,  by  definition,  the  common  value 
of  the  other  two. 

The  two  integrability  concepts  introduced  above  are 
related  as  follows.  For  simplicity,  »  R  is 

taken,  but  the  argument  is  seen  to  be  valid  if  R  is 
replaced  by  a  u-compact  Hausdorff  space. 


Theorem  2.4.  Let  B  be  the  Borel  a-algebra  of  R  ,  and 
0:Bx8-C  be  a  bimeasure.  Then  each  pair  f^€K(R),i» 
1,2  ,  is  B-lntegrable  in  the  sense  of  Definition  2.3. 
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and  A  :  (f^ , £2)  j*  j*  (f^^^e  given  by  (8)  defines  a 
bounded  C-bimeasure  of  Definition  2.1  on  X(R)xX(R)  . 


agree 


II  (f1,f,)d9  -  (Kr)II  (f,,f2)dA  . 

KK  1  z  RK  1  z 


On  the  other  hand,  if  A  ;X (R)xX (E) * C  is  a  bounded  (not 


(from  X  (R)xX  (R)  ,  or  more  generally)  of  8-integrable 
functions,  is  MT-integrable  relative  to  A  and  the  re¬ 
lation  (9)  holds. 


Proof.  In  proving  this  result  several  properties  of  8- 
integrals  established  in  [19]  and  those  of  MT-integrals 
from  [9]  and  [17]  will  be  utilized.  Indeed  it  is  an 
elaboration  of  ([19],  Thm.  7.2)  and  complements  some  of 
its  statements. 

Let  6:8x8  -C  be  a  bimeasure  so  that  |j8  jj  <£x]R)  <  » 
and  let  (f,g)  be  8-integrable.  The  definition  of  8- 
integrability  implies  that  each  pair  of  bounded  Baire 
functions  is  8-integrable  (cf.  [19],  p.  126).  So,  if 
u,v€K (R)  ,  then  (u,v)  is  8-integrable  and  the  mapping 

A:(u,v)  ►*  J*  J*  (u,v)d8  is  well  defined  and  A  is  a 

R  R 

bounded  bilinear  functional.  In  fact,  |a(u,v)|  s 
He'll  (R,R)  j|u'j|—ijv||—  where  !|  *  |j—  is  the  usual  supremum 
norm  on  X(R)  .  Thus  A  is  a  bounded  C-bimeasure,  by 
Definition  2.1.  Consequently  A(-,v)  and  A(u,*)  de¬ 
fine  bounded  (complex)  Radon  measures  on  8  ,  because 
every  a-additive  function  on  the  Baire  cr-algebra  of  a 
a -compact  space  into  a  Banach  space  has  a  (bounded) 
Radon  extension  onto  its  Borel  a-algebra,  by  the  stand¬ 
ard  measure  theory.  Using  the  same  symbol  A(*,v)  for 
this  extended  measure ,  one  has 


A(f,-)(v)  -A(*,v)(f)  «  Jf(x)8 (dx,R)  ,  v€K(R)  , 

R  V 

°  j'v(y)f0(R,dy)  ,  by  (8)  since 
R  r 

(f,v)  is  8-integrable ,  (10) 

where  the  first  equality  obtains  by  definition  of  this 
symbol  (cf.  [9]).  Since  f3(R,*)  is  also  a  regular 
measure  on  ft  ,  (10)  shows  that  A(f,-)  on  K(R)  is  a 
bounded  linear  functional  and  hence  defines  a  (complex) 
Radon  measure  on  ft  .  So  (10)  holds  if  v  is  replaced 
by  any  Baire  function  g  ,  provided  the  integral  on  the 
right  side  exists.  Since  (f,g)  is  8-integrable,  it 
does  exist  by  (8),  and  one  has: 

I  j*  (f,g)d8  -J,g(y)f3(R,dy)  -  jg(y)A  (f  ,dy)  »A(f,-)(g)  • 

1RR  R  r  R 

(ID 

A  similar  reasoning  shows  that  A(-,g)(f)  exists  and 

equals  j"  j*  (f  ,g)d8  ,  so  that  A(f,*)(g)  «A(-,g)(f)  , 

R  R 

and  (f,g)  is  MT-integrable . 

For  the  last  part,  let  A  be  a  bounded  C-bimeasure 
on  K(R)xK(R)  .  Then  a  pair  of  bounded  Baire  functions 
(f,g)  is  MT-integrable  as  a  consequence  of  ([9],  Thm. 
11.1),  since  A  is  a  bounded  C  -bimeasure.  By  the 
theory  of  [9],  for  each  bounded  Baire  function  f  or 
g  >  A ( • ,g)  and  A (f , • )  determine  (complex)  bounded 
Radon  measures  on  ft  .  If  we  define  a  function  8  rftxift  - 
C  by  3(E,F)  ■  A(X£,Xp)  ,  then  3  is  seen,  after  a 
standard  computation,  to  be  a  complex  bimeasure  (hence 

bounded).  If  now  A':(h,k)  »-  ff  (h,k)d3  is  defined  for 

R  R 

each  pair  of  bounded  Baire  functions  (h,k)  ,  then  by 
the  first  part  a'  is  a  C-bimeasure  and  A'(XE,Xp)  » 
A(Xg,Xp)  so  that  A '  (u,v)  ■  A(u,v)  for  u,v  in  K  (R)  . 
The  extension  procedure  then  shows  that  A /  ■  A  and 
(9)  holds.  This  completes  the  proof. 
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Remark.  There  exist  (unbounded)  <£ -bimeasures  A  on 
K (R)xK (R)  (or  any  noncompact  a-compact  space  S  in 
place  of  E  )  such  that  it  induces  a  complex  bimeasure 
0  ,  which  is  thus  bounded,  and  for  which  (9)  holds  for 
all  0-integrable  pairs  (f,g)  ;  but  there  exists  a  A-in- 
tegrable  (not  bounded)  pair  (h,k)  which  is  not  0-inte- 
grable,  i.e.,  (8)  does  not  hold.  An  example  of  this 
phenomenon  is  given  in  ([19],  Remark  7.3).  Thus  in  the 
above  theorem,  it  is  essential  that  A  remains  bounded 
after  it  is  extended  from  X(S^)xX(S2)  to  more  functions. 

The  integrability  of  a  pair  (f,g)  relative  to  a 
bimeasure  0  as  in  Definition  2.3,  and  hence  for  the 
MT-integral  (by  the  above  theorem),  is  not  absolute. 
Indeed,  the  integrability  of  (f,g)  for  0  does  not 
necessarily  imply  the  same  for  (fX^jg^g)  >  » 

in  contrast  to  the  Lebesgue  theory.  This  is  seen  from 
the  following  example.  We  use  the  fact  that  the  theo¬ 
rem  is  true  if  E  is  replaced  by  a  a-compact  set. 

Example  2.5.  Let  the  underlying  spaces  S^  =  S£  *  Z 
(the  integers),  E  *  P(Z)  the  power  set.  Let 
0((m},[n})  *  (|m|+|n|)"^  for  |n|+|m|  f  0  ,  *  0  other¬ 
wise,  m,n€Z  .  Now  £  E  (|mf+|n|  )“^  <  «  so  that  for  any 

m  n  2 

E,F6P(Z)  we  can  define  0(E,F)  ,  and  extend  it  to  P(Z  ) 

by  additivity  (with  values  in  E+  ) .  Then  one  can  verify 
that  1 0  j  (Z,Z)  <  ®  ,  i.e.,  (2)  holds.  Let  f(x)  *  g(x)  « 
x  ,  x€Z  .  Then  for  each  E  c  Z  ,  we  have 

jf  (x)3  (dx,[m})  «  E  n(|n|+|m|)"4  ,  m€Z  . 

E  n€E-[ 0] 

Since  the  series  is  convergent,  f  is  0 (• ,F)-integrable 
for  each  F€P(Z)  ,  and 

J* f  (x)0  (dx,F)  -  E  E  n(  jm|+|n|  )“4  . 

E  n€E-[  0}  m6F 

Similarly  J*  pg  (y )  3  (E,dy)  exists.  Also  for  each  F  c  S2  ■ 

Z  , 
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fSCS^F)  -  J*  f(x)3(dx,F) 
si 

and  likewise  ^(E^)  *  0 
(f,g)  is  3 -integrable  and 

Now  let  A-  B  -  Z+  . 


»  E  2  n(|m|+|n|) 

m€F  n€Z-[  0 } 

for  each  E  c  *  Z  . 

J  ;s  (f,g)dB  -  0  . 
bl  b2 

Since  f3(A,F)  =  j*f(x) 

^  A 


-4  _ 


Hence 


f  (x)3  (dx,F) 


»  E  En(n+|m|)"4  ,  and  E  E  — SS_  =  .  ?  so 
„  m€F  nsl  m*l  n-1  (m+n)^ 

oBg(y)f^  (A,dy)  does  not  exist.  But  f3(A,*)  * 

X  f0(si»*)  •  Hence  js  (Xgg)(y)x  f@(S1}dy)  does  not 
A  2  A 

exist.  Thus  (X^f,Xgg)  is  not  integrable  in  the  sense 
of  Definition  2.3  even  though  (f,g)  is. 

Now  by  Theorem  2.4,  if  A  is  the  induced  <E-bimeas- 
ure  by  3  ,  then  (f,g)  is  also  MT-integrable  and  its 
integral  vanishes  by  (9).  But  again  (XAf,Xgg)  is  not 
MT-integrable  as  follows  from  a  similar  computation. 

Thus  the  pathology  is  present  also  for  bounded  (C-bimeas- 
ures . 

To  eliminate  this  unpleasant  behavior,  we  shall  now 
strengthen  the  definition  of  integrability  relative  to 
a  bimeasure  in  such  a  way  that  all  bounded  functions  are 
again  integrable.  Thus  we  shall  restrict  the  (unbounded) 
set  of  integrable  pairs  of  functions,  but  the  bimeasure 
itself  is  left  relatively  unrestricted.  However,  it  may 
be  of  interest  to  note  that  !!3|i(RxK)<  |  3  j  QRxB.)  ■  •  can 
happen  even  if  3  is  a  positive  definite  bimeasure. 
Counterexamples  illustrating  these  points  are  not  ob¬ 
vious.  Using  a  modification  of  an  example  due  to  H. 
Helson  and  D.  Lowdens lager ,  an  example  was  discussed  in 
[13].  It  uses  a  deep  result,  due  to  S.  Bochner,  on  the 
planar  extension  of  the  F.  and  M.  Riesz  theorem  on  abso¬ 
lute  continuity  of  measures.  A  general  counterexample 
can  also  be  obtained  by  a  nontrivial  modification  of 
that  of  ([2],  p.  840)  to  show  that  ’,|  3  li  (RxR)  *  |  3  |  ORxR) 

■  ®  holds  when  3  is  a  bimeasure  which  is  not 
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necessarily  positive  definite.  For  brevity,  the  details 
of  this  will  not  be  included  here. 

To  avoid  the  troubles  of  Example  2.5,  let  us  intro¬ 
duce  the  following: 

Definition  2.6.  Let  be  measurable  spaces, 

f^:n^-,<C  be  measurable  functions,  i  a  1,2  .  If  0: 
^lxS2-’®  £s  a  bimeasure>  then  the  pair  will 

be  termed  strictly  3-integrable  if: 

(a)  f^  is  @(*,F)-  and  f2  is  0 (E, • )-integrable 
for  each  E€E^,F€E2  >  so  that  £  3 (E, • )  ^  - C  and 

0f2^*  ,F)  :S1  8iven  by  f  P(E,B)  "  ■»'E:Cl(tt,l)®(d®l»B)  , 
B€£2  >  a^d  3£^(A,F)  “  J*f^2 (u,2^®  (Ajdu^)  ,  A6E^  ,  are 

complex  measures  for  each  E€E^,F€E2  >  and 

(b)  f^  is  0£  (• ,F)-integrable  for  each  F€E2  , 

and  f2  is  f  3 (E , • )  - integrab le  for  each  ECE^  ,  and 

J*  e^i  (UJi)3f  (duu^  ,F)  ■  (^Jf  ^(E,d(ju2)  holds  for 
2  1 

E€E^,F€E2  •  When  these  conditions  obtain,  the  integral 
is  denoted  by 

*^(f1(l2)ds  -  '  /(XEf1,XFf2)d0  -{f1(«1)#f2(<to1.F)  . 

(12) 

It  is  not  difficult  to  verify  that  each  strictly 
3-integrable  pair  is  3-integrable  in  the  sense  of  Defi¬ 
nition  2.3  with  the  same  value.  If  |i:(A,B)  *- 
j*S  J  5  (^^1  ,^b^2^®  *  A€E^ ,B€E2  and  (f^,^)  is 

strictly  3-integrable,  then  m>  is  a  bimeasure  on  E^xS^ 

since  f  )  : 

£1’£2 

U  (A,B)  "  J’Afl^UJl^f2^dtUl,B^  »  A€E1,B€E2  • 

It  may  be  easily  seen  that  the  results  on  3-inte- 
grability  given  in  ( [ 19 J ,  Thms .  5.4  and  5.6,  Corol.  5.7) 
are  also  valid  for  strict  3-integrals.  In  particular, 


< 
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each  bounded  measurable  pair  (f,g)  is  always  strictly 
8-integrable.  The  following  "change  of  variables"  for¬ 
mula  holds  : 

Theorem  2.7.  Let  (f,g)  be  strictly  S-integrable  on 
(  (C^*^)  ,i"l,2}  for  a  bimeasure  3  on  E1xE2  .  Let 
u(A,B)  «  “,’a1^o2(XAf>XBg)d0  »  A6E1sB€E2  .  If  hsOj-C  , 
k:Q2“*(C  are  bounded  measurable  functions,  then  the  fol- 

f  »g' 

(13) 


lowing  formula  holds :  (again  4  -  u-  ) 


X  X  (fh,gk)d@ 

AB 


j  X  (h,k)du  ,  A€E,  ,B€E, 
AB  12 


E]_xE2 


Proof.  As  noted  above,  u  is  a  bimeasure  on 
Define  a  linear  functional  k^,  on  the  space  of  scalar 
measures  ca(n2,E2)  as: 

k£(*)  “  j*Fk<w2)X(dtt»2>  ,  F€L2  ,  X6ca(n2,E2)  , 
where  k  is  given  in  the  statement.  By  the  structure 
of  measurable  functions  there  is  a  sequence  of  step 
functions  kn-k  pointwise, 

*  -  E  b^X  . 

S-l  J  »J 


|  k  |  s  | k |  ,  and  so  let 


n 


Then  for  each  E€E-, 


one  has 


9gk(E.D 


(gk)  (-ju2)3  (E,duu'2)  ,  by  definition, 


limX(gkn)(u)2)e(E,du>2) 

n— •  F 


,  by  the  dominated  con¬ 
vergence  , 


■  liffl  E  b?3_ (E,F'3b7) 
n— j-1  J  8  J 

“  k  (nJ2)3B(E,d(ju2) 

p  u  *  s  4 

■  Xk(<u2)3g(E,du)2)  ■  k^  (3g (E ,  • ) )  . 

Hence  using  the  standard  theory  ([4],  p.  180), 

X(gk)(jj2)f3(E,duj2)  -  kjj, (  X  g(u»2)f3  (E,du»2)) 

F  (• ) 

-  k^(Xf  (a»1)3g(di«1,  •  )) 

E 
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This  shows  that  (f,gk) 
further 


-  J*f(a.1)k^(0g(du.1,-)>  ,  by  ([4], 

P.  324), 

"  gf  (UJi>0gk(duJl’F)  • 

is  strictly  3-integrable  and 


i;  (f,gk)d8  -k^(n(E,.)>  -  :k(Uu2)u(E,dm2)  -ak(EfF)  .  (14) 
E  F  F 

By  a  similar  argument,  one  shows  that  (fh,gk)  is 

strictly  9-integrable  and 

j*  J*  (fh,gk)d@  -  Jh (dou,  ,F >  -  j*  j**(h,k)dta  . 

EF  E  1  K  1  EF 

This  is  (13)  and  the  proof  is  complete. 

The  corresponding  statement  for  the  bounded  <C-bi- 

measures  and  MT-integration  may  be  stated  as  follows: 

Theorem  2.8.  Let  (S^ft^),  i*l,2  be  j-compact  Borelian 
spaces .  and  f ,g  be^  B^  ^-measurable  scalar  functions. 
Let  A  be  a  bounded  (C-bimeasure  on  S^xS2  .  Then  the 
pairs  (fh,gk)  are  MT-lntegrable  relative  to  A  for 
all  bounded  scalar  Baire  functions  h,k  on  ,  iff 

(XAf,Xgg)  are  MT-integrable  for  all  A€8^  and  B€02  • 
The  proof  of  one  direction  is  immediate,  and  the 
converse  is  similar  to  the  preceding  result  using  the 
interplay  (of  Bourbaki's)  between  the  bounded  linear 
functionals  and  the  (bounded)  Radon  measures.  The  de¬ 
tails  are  omitted. 

The  following  consequence  of  Theorem  2.7  will  be 
noted  for  applications. 

Corollary  2.9.  Let  (S<,ft.),  i*l,2  be  measurable  spaces 


and  8  be  a  bimeasure  on  9^x62  into  C  .  Then  one 
has  : 

(1)  A  pair  (f,g)  is  strictly  3-lntegrable  iff 
the  pair  (|f|,|g|)  is.. 

(ii)  If  the  f^.’S^-C  are  measurable,  i  ■  1,2  , 
and  |  f  L )  s|f|  ,  |  f  2 1  *  1  g  I  and  (f,g)  is  strictly 


4 


Proof.  (i)  and  (ii)  are  immediate .  Regarding  (iii), 
by  (ii)  (f,g)  is  strictly  0-integrable .  Further, 

J*  .f*(f,g)d@  -  .Tf(x)0-(dx,F) 

E  F  E  8 

-  lim  j*  f  (x)0-(dx,F) 

n-**  E  “  ° 

*  11m  J*  g(y)f  0  (E,dy) 
n—  F  rn 

-  lim  limj* gj-CyJf  0(E,dy) 
n-«  m-*  F^“  rn 


-  lim  limj’ j**(f  ,g^)d0  ,  by  a  similar  argu- 
nr**  n— 00  E  F 

ment . 

This  is  (15),  and  the  result  follows. 

In  exactly  the  same  manner,  if  the  (XAf,Xgg)  are 
MT-integrable  relative  to  a  C-bimeasure  A  :X (S^)xK (S2)  - 
C  ,  then  the  above  three  statements  hold  for  the  MT- in¬ 
tegrals  ,  using  Theorem  2.8. 

These  results  will  be  sufficient  to  present  the 
work  on  harmonizable  processes  and  their  extensions  to 
Cramer  classes. 

III.  INTEGRAL  REPRESENTATIONS  OF  PROCESSES.  The  pre¬ 
ceding  analysis  justifies  the  integration  in  (4)  and 
one  uses  the  strict  3-  (or  F  -  in  (4))  integrability 
In  what  follows  only  this  strict  integral  will  be  used 
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and  the  word  Strict"  will  be  dropped  hereafter  since  no 
other  concepts  will  be  employed.  In  (4),  the  integrand 
is  a  bounded  continuous  function.  If  0  is  restricted 
to  functions  with  Vitali  variation  finite,  then  the 
"strict"  and  the  "ordinary"  (those  in  the  sense  of  Defi¬ 
nitions  2.2  and  2.3)  integrals  coincide. 

The  purpose  of  this  section  is  to  show  that  every 
weakly  harmonizable  process  admits  an  integral  repre¬ 
sentation;  in  fact  to  show  that  it  is  the  Fourier  trans- 
2 

form  of  an  Lq(P) -valued  (or  a  stochastic)  measure.  Let 
us  present  the  result  in  a  form  which  applies  to  the 
Cramer  class  also,  extending  the  work  of  ([5],  Sec.  4.4). 

Let  r:RxR-C  be  a  positive  definite  continuous 
function.  It  is  then  a  covariance  function  in  the  sense 
that  there  exists  a  probability  space  and  a  stochastic 
process  (Xt,t€]R}  on  it  with  the  given  r  as  its  co- 
variance  function.  To  see  this  let  t^»..*»tn  be  n 
points  from  H  ,  and  note  that  (r  (t^.tj  ) ,  lsi,  jsn)  is 
a  positive  definite  matrix  for  each  n  .  Let  F  t 


be  a  Gaussian  d.f.  with  mean  zero,  and  this  matrix  as 

its  covariance  matrix.  Such  d.f.'s  clearly  exist  on  Rn 

for  each  n a  1  .  The  family  of  all  these  d.f.'s  has 

the  consistency  property,  i.e.,  (i)  limF  (x,,...,x  ) 

x  —  c  !»*••»  cn 


m  F .  f.  Oci  >  •  •  •  )  i  and  (ii)  E.  *.  ("-A  ) 

ti,...,tn-i  1  n  V^n  1  n 

■  F„  ..  (x, , . . .  ,x  )  for  any  permutation  (i, ,...,i  ) 

cl*  * ‘ * ,cn  A  n  1 

of  (l,...,n)  .  It  then  follows  from  a  fundamental  re¬ 
sult  of  Kolmogorov  (and  Bochner)  that  there  exists  a 
probability  space  (n,S,P)  ,  and  a  real  process  (Xt,t€R} 

on  it  such  that  P[X„  <x. , . . .  ,X„  <xl  ■  F„  „  (x,^..,x„)  . 

C1  1  cn  n  Cl’-’Cn  1  n 

Here  the  finite  dimensional  d.f.'s  are  the  given  F's 

so  that  it  is  Gaussian  and  hence  the  covariance  function 

is  the  given  r  and  mean  function  is  zero.  (For  a 


I 


I 


I 


I 


I 


I 
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proof  of  this  statement  and  related  material  on  the  ex¬ 
istence  of  such  processes,  see  [12],  Sec.  1.3.)  This 
result  also  implies  that  the  covariance  functions  given 
by  (1),  (4)  or  (6)  are  in  fact  such  functions  of  con¬ 
crete  stochastic  processes  and  not  some  fictitious  ob¬ 
jects,  and  the  theory  thereby  gains  importance  for  ap¬ 
plications.  Consequently,  if  F  :3RxR-C  is  a  positive 
definite  function  which  is  only  of  locally  finite 
Frechet  variation  in  the  sense  that  on  each  compact 

rectangle  Ixl  c  ExR  ,  F_  satisfies  I'lF.iI  (Ixl)  < «  so 

z  z 

that  (5)  holds  on  Ixl  (but  ||F  !1  (JRxR)  «  »  is  possi- 

z 

ble),  let  {g (s ,  • )  ,s€]R}  be  a  family  of  Baire  functions 
z 

on  H  -•  C  .  Suppose  that 

; ;  gz  (s ,x )g2 (s  ,x ' )f  (dx  ,d\ ' >  < -  ,  sen  ,  (i6) 

R]R 

where  the  symbol  denotes  the  strict  integral  relative  to 

the  (local)  bimeasure  F„  .  For  instance  each  g  (s  ,  •  ) 

z  z 

can  have  compact  supports.  It  is  clear  how  the  inte¬ 
gration  theory  of  the  preceding  section  can  be  adapted 
to  this  situation  with  a  modification  of  the  classical 
methods  (cf.  e.g.,  [1]).  If  r_  is  defined,  for  a 

family  of  F  -integrable  Baire  functions  [ g(s , • ) ,s€]R}  , 
z 

as 


rz(s,t)  -  ;:gz(s,X)gz(t,OFz(dX,dX')<-  ,  (17) 

K  R 

then  it  is  a  covariance  function.  The  corresponding 
process  [Z^,t€]R}  with  this  r  as  its  covariance  will 
be  called  weakly  of  Cramer  class.  This  is  the  most  gen¬ 
eral  nonstationary  family  that  can  be  studied  with  these 

is\ 

methods.  If  g  (s,X)  ■  e  ,  then  this  reduces  to  the 

Z 

weakly  harmonizable  case,  provided  the  F  is  a  bi- 
measure  on  RxR  (i.e.,  not  merely  locally). 

To  present  the  general  representation,  it  is  also 
necessary  to  recall  the  integral  of  Dunford  and  Schwartz 


([4],  Sec.  IV. 10)  of  a  scalar  function  relative  to  a 
vector  measure  in  the  form  needed  here. 

Definition  3.1.  Let  (R,8)  be  the  Borelian  line  and 

(Q,E,P)  be  a  probability  space.  If  L  (P)  is  the 

usual  Hilbert  space  on  (n,E, P)  ,  then  a  mapping  Z:B- 
2 

L  (P)  which  is  a-additive  in  the  norm  topology  of 
2 

L  (P)  is  called  a  vector  measure,  and  a  stochastic 

measure  if  also  E(Z(A))  -  0  for  each  A€8  .  If  f  * 
k  n 

n  n 

E  avX.n  ,  A? €8  is  a  step  function,  then,  as  usual,  we 
i-1  1  Ai  1  kn 

let  gB  -  J* fdZ  -  E  a?Z(A?HB)  ,  B€B  (which  is  seen  to 
n  B  i-1  1  1 

be  uniquely  defined)  and  if  f  -f  pointwise,  and 

R  2  ^ 

Cgn,nal}  c  L  (P)  is  a  Cauchy  sequence  for  each  B€®  , 

then  the  unique  limit  gB  »  limj*  f  dZ  is  denoted  jfdZ 
„  n—  B  n  B 

-  limj  f_dZ  ,  B€B  ,  called  the  Dunford-Schwartz  (or  D-S) 
n—  B  n 
integral. 

2 

This  concept  is  a  specialized  form  (to  L  (P)  )  of 
that  given  in  ([4],  IV. 10. 7)  where  it  is  shown  that  the 
integral  is  uniquely  defined,  does  not  depend  on  the 
sequence  used,  and  is  linear.  Taking  Z(-)  as  the  sto¬ 
chastic  measure,  the  integral  was  defined  differently 
in  [3],  [8]  and  others,  but  it  can  be  seen  to  be  a  spe¬ 
cialized  version  of  the  above  definition.  If  Z:B(K)- 
2 

L  (P)  is  a  stochastic  measure  for  each  compact  K  c  n 
(fl(K)  is  the  trace  a-algebra  of  S  on  K  ) ,  so  that 
Z  will  be  a  stochastic  measure  on  the  6 -ring  Bq  c  b 
of  bounded  Borel  sets,  then  again  the  D-S  integration 
extends  to  this  "local"  situation  with  only  simple  modi¬ 
fications.  (A  special  development  to  this  case  was  given 
by  Cramer  in  £2 J  to  use  it  with  (6);  and  a  similar  result 
holds  with  (17) . ) 

We  can  now  present  a  general  integral  representation 
for  processes  whose  covariance  is  of  the  type  (1),  (4), 


(6)  or  (17).  This  is  essential  for  the  sampling  theory 
of  the  next-  section  and  the  interplay  between  the  D-S 
integral  and  the  strict  integral  of  Definition  2.6  plays 
an  important  role  in  the  present  work. 


Theorem  3.2.  Let  (Xt,t€R}  be  a  second  order  process 

on  (Q,Z,P)  ,  weakly  of  Cramer  class,  in  the  sense  that 

E(X  )  *  0  and  its  covariance  function  r  is  repre- 

sentable  by  (17)  relative  to  a  positive  definite  local 

bimeasure  F  and  a  family  of  functions  (g  (s,-)>s€®.} 

which  are  strictly  F  -Integrable.  Then  there  exists  a 

^  2  ~  — 

stochastic  measure  Zx:8q-L  (P)  such  that 

(i)  E(ZX(A)Z^(B))  -  FX(A,B)  ,  A,B€8Q 

(ii)  X(t)  "  -',Rgx(t:,X)2x(dX)  ,  t6]R  ,  (18) 

where  8q  is  the  6 -ring  of  bounded  Borel  sets  of  R  , 
and  the  integral  on  8q  in  (18)  is  in  the  D-S  sense. 

If  Fx  is  a  bimeasure  on  then  8q  can  be  replaced 

by  the  Borel  s-algebra  8  and  j*  J* ’g  (s , X) g  (s , X*) F„(dX , dX' ) 

]RR  x  xx 

<  «  ,  s€lR  ,  for  any  bounded  Baire  family  tgv.(s,*)  ,  s€R} 

Conversely,  if  (X(t),t€]R}  is  a  process  defined  by 

(18)  for  a  class  ( g..(s  ,  •  )  ,s€]R}  of  D-S  integrable  func- 

tions .  then  (Xt,t€]R}  is  weakly  of  Cramer  class,  and 

the  g  (s,-)'s  are  F  -  integrable  strictly,  where 

X  X 

Fx(-,»)  ,  given  by  (i),  is  (locally)  a  bimeasure  on  8q 
the  6-ring  of  bounded  Borel  sets  of  R  . 

The  special  case  of  importance  here  is  when  the 
process  is  weakly  harmonizable ,  or  of  Cramer  class  (6). 

In  the  latter  case  F  is  of  finite  Vitali  variation 

X 

on  each  compact  rectangle  and  the  integral  with  F  is 

X 

a  planar  Lebesgue-Stieltjes  integral.  In  this  event, 
the  result  reduces  to  the  representation  established  by 
Cramer  himself  in  [3] .  The  proof  of  the  above  theorem 
is  an  extension  of  [3]  using  the  theory  of  bimeasures 
given  in  the  preceding  section.  The  details  have  been 
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spelled  out  in  ([13],  Sec.  3),  and  will  not  be  repro¬ 
duced  here.  Let  us  state  the  harmonizable  case  sepa¬ 
rately  for  ready  reference  and  to  use  it  in  Section  IV. 

Theorem  3.3.  Let  [Xt,t€H}  be  a  process  with  E(Xt)  = 

0  and  E(|XC|Z)  s  KQ  <«  ,  t€lR  .  Then  it  is  weakly  har¬ 
monizable  relative  to  a  positive  definite  bimeasure  Fx 
on  8x8  ,  iff  there  exists  a  stochastic  measure  Zx:8  - 
l7(P)  such  that  E(ZX(A)Z“(B))  -  FX(A,B)  ,  A,B€8  ,  and 

Xt  -  jReitXZx(dX)  ,  t€*  ,  (19) 

where  the  Integral  is  in  the  D-S  sense.  The  process  is 
strongly  harmonizable  if  Fx  ,  related  to  Zx  of  (19). 
is  of  finite  Vitall  variation.  |Fx|(RxR)<«  .  In  either 
case  Xt  is  uniformly  continuous  in  t  with  the  norm 
topology  of  the  range  space  L  (P)  . 

The  weakly  harmonizable  processes  were  also  called 
"V-bounded"  by  S.  Bochner  who  was  the  first  to  introduce 
them  into  the  stochastic  theory  in  1954,  and  later  (in¬ 
dependently)  were  again  defined  by  Yu.  A.  Rozanov  in  [16] 
with  an  indication  of  the  need  for  integration  akin  to 
Definition  2.6.  A  comparison  (and  equivalence)  of  these 
concepts  and  other  characterizations  are  given  in  [13] . 
The  representation  in  this  case  has  also  been  obtained 
by  Niemi  ([10],  p.  35)  by  a  slightly  different  method. 

But  he  was  the  first  to  recognize  the  use  of  MT  inte¬ 
gration  in  this  study  with  V-boundedness . 

If  in  (6)  or  (17)  the  function  F„  concentrates  on 
the  diagonal  of  H  ,  then  one  has  Fx(X,\')  ■  \\/Gx^ 
[3^/  is  the  Kronecker  delta]  and  so 

rx(s,t)  -  .’Rgx(s,X)gx(t,\)Gx(d\)  .  (20) 

Processes  for  which  r  has  this  special  property  are 

**  is  \ 

said  to  be  of  Karhunen  c las s .  If  g  (s,X)  -  e  then 
this  reduces  to  the  (weakly)  stationary  case.  Thus  a 
harmonizable  Karhunen  class  is  simply  stationary.  If 


this  happens  in  (18)  and  (19),  the  stochastic  measure 
has  the  additional  property  of  orthogonal  increments, 
i.e.,  E(ZX(A)Z^(B))  *  Gx(AHB)  .  In  all  these  cases  Fx 
(or  G  )  the  positive  definite  bimeasure  representing 
r  is  called  the  spectral  measure  of  the  process.  This 
function  plays  an  important  role  in  the  sampling  results 
of  the  next  section.  Its  significance  for  this  problem 
is  further  pointed  out  in  the  last  section.  Theorem  3.2 
for  the  Karhunen  case  becomes  simpler,  and  this  is  given 
in  ([5],  p.  201). 

IV.  SAMPLING  THEOREMS.  Since  it  may  be  costly  or  dif¬ 
ficult  to  observe  the  whole  process,  it  is  desirable  to 
sample  the  observations  at  fixed  intervals.  However,  by 

regarding  our  process  as  a  curve  in  the  Hilbert  space 
2 

L  (P)  ,  it  is  clear  that  two  essentially  different  curves 
(or  processes)  can  pass  through  a  fixed  set  of  equidis¬ 
tant  points.  This  is  usually  called  the  "aliasing"  prob¬ 
lem  and  it  is  desirable  to  avoid  this  by  choosing  the 
spacing  unit  carefully.  Thus  the  sampling  problem  is  to 
find  conditions  on  the  characteristics  (or  the  spectral 
function)  governing  the  process  such  that  it  can  be  de¬ 
termined  from  a  countable  set  of  observations.  In  other 
words,  if  L(X)  -  sp[Xt,t€]R}  c  l2(P)  ,  and  in(X)  - 

,t<  are  points  at  which  the  process  is  to  be  ob- 
i  1 

served}  ,  then  L(X)  *  fh (X)  .  If  tR  *  ±hn  where  h>0 

is  the  unit  to  be  chosen,  then  it  is  called  periodic 

sampling,  and  if  (t_,nal]  is  a  bounded  infinite  set  of 

n 

distinct  values,  then  it  is  nonperiodic  sampling. 

For  the  classes  considered  in  the  preceding  section, 
the  process  characteristic  is  the  spectral  function  by 
which  one  classifies  the  process.  So  the  conditions 
should  be  on  such  a  function.  For  the  periodic  sampling 
of  weakly  harmonizable  processes,  the  following  general 


sptXc 


result,  called  a  sampling  theorem,  holds: 


Theorem  4.1.  Let  [X..,t€]R}  be  a  weakly  harmonizable 


rocess  with  zero  means  and  a  spectral  function  F 


lated  by  (4) .  Given  e  >0  ,  there  exists  a  bounded 
Borel  set  A  («Af)  such  that 


;  c:  cFx(d*,d;0  <  e/4  ,  Ac  *  K.  -  A  , 
A  A 


and  if  •  diameter  of  A  ,  then  for  any  a>CTQ  one 

has  (with  llxtl|2  ■  E(|Xt|2)  )  an  n(*n  )  such  that 

ilx(t)  -Xn(t)||  sc  C(t)a[(a-o0)n]"1+e  ,  (21) 

n 

where  X  (t)  -  Z  a,(t;a)X(kTT/a)  ,  t€]R  ,  and  0<C(t)< 
k*-n 

is  bounded  for  t  in  bounded. sets .  The  coefficients 


s  may  be  taken  to  be : 

«*<«*«>  -  •  <22> 

If  the  spectral  function  F__  has  a  bounded  support 


then  we  can  set  e  ■  0  in  (21). 

Proof.  Since  {Xt,t€]R}  is  weakly  harmonizable,  there 
is  a  stochastic  measure  Zx:fl-L2(P)  satisfying  (19), 
and  such  that  FX(A,B)  *  E(Zx(A)Z^(B) )  .  Also 


-ii;i-z_(dx)! 


!!  ,  US  ing 

([4], IV. 10. 10) 


j*  F  (dX  ,d\  ' ) 


Hence  given  s>0  ,  there  exists  nQ  (*nQ(s)  )  such 
that  n  a  Uq  ® 

:;F„(dx,dx')-;:xr_„  ^(^x,  ^Fjdx.do^^se 


li: 
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This  may  be  written  alternately  in  the  following  form 
which  also  obtains  from  the  fact  that  1-X^_n  n)*0 
boundedly  and  the  same  theorem  of  [4]  as  in  (23)  applies 

j*  ;Fx(dx,dx^  *  ii/d -xA  (x))zx(dx>ii2  =  :izx(A^)ii2-o 


A=AC 


where 


[-n,n)  so  that  for 


(24') 

one  has  ]|Z  (A^  )|| 
x  nQ 


<  e/16  by  (24').  (We  can  actually  choose  j|Zx!l  (A^  ) 
e/4  by  [6],  Thm.  3.5  here.)  That  this  fact  holds 
for  vector  measure  more  generally  is  proved  in  ([6], 
Thm.  3.5). 


Cons ider 


X(t) 


Writing 


/eitXZ(dX) 

R 


iitkZ(d\)  +  /  eiUZv(dX) 


Xx(t)  +x2(t) 


*0 

(say) . 


Z  (A  n.)  and  Z~  »  ZV(A^  n.)  ,  and  not- 
x  n.Q  4  x  uq 


ing  that  these  are  again  stochastic  measures,  it  fol¬ 


lows  that 
Moreover, 


are  also  weakly  harmonizable . 


',|x(t)-x,  (t)!i  -  ||x,(t)H  -  S!  J*  eitxzv(dx);|  *  i-;iz J!(a®  ) 


S  4  supi'i'Zx(E)ii  se/4  ,  by  ([4], 


IV.  10.4(b))  (cf.  also  [6], 
Thm.  3.5).  (26) 

Since,  if  f£(X)  *  e^c^  ,  ft(*)  is  an  entire 

function  of  exponential  type  (with  finite  exponent  [  *  1 
here]),  the  classical  results  on  approximation  imply 
(cf.  [18],  Sec.  4.3;  these  are  given  in  the  form  needed 
by  Piranashvili  [10],  but  the  present  one  is  simply  the 
classical  Kotel 'nikov-Shannon  formula,  cf.  [5],  p.  204) 
with  z  ■  and  Oq  a  Hq  ,  for  any  3>Cq  :  n  ^  ne . 
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I 


izX  “  ten,  sina(z-— )  LQ(z)a 

6  ~  1, J  exp  a  ^  .  kn.  (a-an)n 

k»-n  a  (z-  — )  v  0' 


where  Lq(z)  is  finite  for  z  in  bounded  domains  in 
the  complex  plane.  (A  more  general  form  of  this  esti¬ 
mate  for  any  entire  function  of  finite  exponential  type 
appears  in  the  proof  of  the  next  result.)  Define 
Xn,  (t)  by: 

0  , 

n0  w  s  in  a  ( t  -  — ) 

x_  (t)  «  E  X© - r-±-  .  (28; 


k*-n'. 


Taking  ak(t;a)  as  in  (22),  it  is  asserted  that  this 

X  ,  (t)-process  satisfies  (21),  St 
n0 

For,  let  5^  (z)  be  the  nonnegative  left  side 

quantity  of  (27).  Then 

;|X(t)-X  ,  (t)ll  *  ;|  :(eltx-  E  e  aak(t;a))Z1(dX)1!  + 

0  An/  k— nu  k  1 

n0  0 

ilX2 (c) "X2  n/  (t)!i  ,  using  (25)  and  (28) 

4  4  >n0 

with  X«  ,  in  place  of  X  ,  if  X 
2  »n0  n0 

is  replaced  by  X2  ; 

4  *nb(e>"’ZxS(An6>+l|X2<':>!l+l,X2.(^il  ’  by 

the  triangle  inequality  and  ( [4]  ,  IV.10.7) 
Ln(t)a  s 

ir^Rfx»®)+4+iix2.n;)<c):i  ■ bx  <26> 

and  (27).  (29) 


Now  consider, 

!!x2  (t) !! 

4  »no 


I  E  ak(t;a)X2  (“)!! 
k-n'0  k  2  a 


9 
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uJSL 


R  k“-n' 


aak(t;a))Z2(dX>; 


n0  iX^L 

S  sup  I  E  e  a  ak(t;a)  I  liZoi!  (R) 
k=-n'Q  K 

L0(c)a  e 

s  [l  +(^T7015-  -  b*  <27>  and  <26> 

1  e  2L«(c)a 

s  Il+I]z r“V’  if  n0  2  ("a -0Q . 

Substituting  this  in  (29)  one  gets  (21)  with  C(t)  * 
L0(t)||Zx!I(R)  • 

If  the  support  of  F  is  enclosable  in  a  compact 

rectangle,  then  for  a  suitable  ng  ,  it  will  be  in 

A  xA  and  hence  X0(t)  *  0  .  Thus  s  *  0  is  possi- 
nA  nA  z 


is  possi- 


“0  0 

ble  in  the  above  estimates.  This  completes  the  proof. 

Remark.  If  the  process  is  strongly  harmonizable ,  then 

Fx  has  finite  Vitali  variation  and  the  analysis  proceeds 

with  Lebesgue  integration,  and  the  result  can  deduced 

from  [11].  However,  in  the  weakly  harmonizable  case, 

this  is  not  possible  and  the  vector  (or  D-S)  integration 
2 

in  L  (P)  and  its  relation  with  the  MT-integration  of 
bimeasures  must  play  a  central  role. 

To  illuminate  these  ideas  further,  we  present  an¬ 
other  (periodic)  sampling  theorem  for  some  Cramer  class 
processes.  Recall  that  a  process  [X^,t€]R}  is  of  weakly 
Cramer  class  if  it  has  means  zero  and  its  covariance 
function  rx  admits  a  representation  as  (17)  relative 
to  a  spectral  measure  function  Fx  ,  of  local  finite 
Fr^chet  variation  and  a  family  C  g  (s  ,  • )  ,s  €3R]  of  F  - 
integrable  complex  functions.  Then  by  Theorem  3.2,  the 
Xt  process  admits  an  integral  representation  (18)  re¬ 
lative  to  a  a-additive  Z:flQ-*L^(P)  f  the  integral  being 
(an  extended)  one  of  D-S  type.  In  a  related  terminology 
(R,&,8q,Z)  becomes  a  "semi-standard  quasi-measure  space" 
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3 


\ 


< 


4 


(cf.  [6],  p.  210)  and  the  integral  becomes  the  same  vec¬ 
tor  integral  of  [6].  For  the  following,  the  g(s,X)'s 
will  be  assumed  to  satisfy  two  growth  and  smoothness 
conditions : 

(i)  each  g(-,X)  can  be  extended  to  be  an  entire 
function,  X€1R  ; 


(ii)  if 


cn(X> 


then 


dz 


*  ,  . 
c  (X) 


<®  ,  and  there  is  an 


n<z*x>|2-0 

11m  sup  [|cnU)|l1/n*ci0 

n-*» 

integer  m*0  ,  such  that 

|g(z,X)|  sL(X)(l+|z|m)exp(c*(X)|y|}  ,  z»x+iy 
In  the  preceding  case  g(t,X)  =*  e 


and  this 

•ft 

satisfies  (i)  automatically.  Regarding  (ii),  c  (X)  » 

| X |  in  that  case .  So  there  is  such  a  Oq  < -  only  if 
the  X's  vary  in  a  compact  set  and  this  will  obtain  if 
F  has  a  bounded  support.  In  the  present  case,  if  the 
Fx  is  not  restricted,  then  the  g(s,*)  should  have  com¬ 
pact  supports.  This  is  reasonable  in  the  Cramer  class, 
and  is  one  of  the  reasons  for  this  generalization.  With¬ 
in  such  a  framework,  the  following  (periodic)  sampling 
theorem  holds: 

Theorem  4.2.  Let  (X(t),t€]R}  be  of  weakly  Cramer  class 
with  its  g-family  satisfying  the  growth  conditions  (i) 
and  (ii)  above.  Suppose  that  L(*)  in  (ii)  is  strictly 

Then 


integrable  relative  to  the  spectral  measure  F 
for  each  a>OQ  >  if  X  (t)  is  given  by : 


x 


x  (C)  -  E  X(^)  3in(at-kTT)sin^3(t-krT/q)  ^  (30) 

n  k*-n  a  (at-krr)@cl(t-kTT/a) 

where  q*m  ,  and  3  <  (a-o^/q  ,  we  have  for  a  constant 
CQ(t,a,q)  <-  : 

!!X(t)-Xn(t)!|sC0(t,a,q)/n  .  (31) 

In  other  words  {X(krt/a)  ,k®0  ,±1  ,±2 , . . . }  spans  the  same 
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space  as  (X(t),t€]R}  . 

Proof.  The  idea  of  proof  is  similar  to  that  of  the  above 
theorem,  and  we  can  quickly  sketch  the  argument.  The 
key  again  is  the  approximation  result  from  function 
theory.  This  is  based  on  a  theorem  of  M.  L.  Cartwright 
(cf.  [18],  p.  186)  as  modified  in  Piranashvili  ([11], 
p.  648).  By  this  work,  one  has 


n 


|g(z,\)-  E  g 
k“-n 


^TTk  ^  ^  sin (az-kn,)sin^3  (z-kn/a)  j 
a  *  (az-kTT)g^  (z-krr/a) 


L(x)Vz)  . ir (SL)q  + 

0q  (a-a-@q)  n  n  n 


(32) 


where  L ( • ) 


is  as  in  (ii)  of  the  growth  condition  and 

z  in  bounded 
.  is  defined  as  in 

then,  if  |vn(z,X)|  is  the 

leftside  quantity,  L(X)h^  (a,z  ,q)  the  right  side, of  (32) 


Lq(z)  is  a  positive  finite  number  for 
sets  of  the  complex  plane.  So  if  Xn(t) 


(30),  and 


cn<c> 


and 


X(t)  -xn(t) 

L(\)hn  (a,z,q) 
J,Rvn(t,X)Z(dX) 
|vn(t,\)|  s L(x) -hn(a,t,q) 


=n<C> 


F  -integrable  and  which  in  turn  implies  that 

A» 


integrable  for 
one  has 


Z(0 


which  by  hypothesis  is 
L(  •  )  is 
Hence  by  ([6],  Thm.  6.11(e)), 


!kn(t) 


s  4supC  !1J*L(\  ) -h  (cl ,t  ,q)Z(dX)!S  :A€B} 
A  n 


-  q  £ - ^[(|)q+(|)q‘m]  -supf  :!jL(X)Z(dX)H  :A€B} 

0q(a-a-0q)  n  n  n 


V(a-a-Bq)  nt(n)  (n)  ] 


A 

(say) . 


(33) 


n 


The  right  side  -0  as 
a  >aQ  .  .  Setting  CQ(t,a,q) 


in  bounded  sets, 
the  coefficient  of  n-^ 


for 
as 

in  (33),  (31)  results  and  completes  the  proof. 

Without  doubt,  this  result  can  be  extended  to  get 
an  t -approximation  by  relaxing  some  conditions,  to  match 
with  the  above  theorem.  We  shall  not  go  into  such  a 
formulation  here.  Instead  some  related  remarks  will  be 


given  in  the  final  section. 


V.  FINAL  REMARKS.  1.  For  stationary  processes,  the 
spectral  measure  F  is  real  (and  positive)  and  a  more  pre¬ 
cise  result  can  be  obtained.  A  characterization  for  a 
periodic  sampling  theorem  is  obtained  by  S.  P.  Lloyd  [7] 
involving  only  the  support  of  Fx  ,  namely  its  translates 
should  be  disjoint  when  the  translation  is  suitably  re¬ 
lated  to  the  sampling  interval  h(*n/a)  .  An  extension 

of  that  result  for  strongly  harmonizable  processes  can  be 
formulated.  The  sufficiency  of  it  has  been  given  in  [14]. 
It  was  stated  there  without  proof  that  the  converse  also 
holds.  This  was  clearly  an  oversight  and  the  problem  is 
still  open,  i.e.,  if  a  periodic  sampling  theorem  holds  for 
a  (weakly  or  strongly)  harmonizable  process,  describe  the 
precise  property  of  the  support  of  the  spectral  measure. 

For  this  reason  in  the  preceding  section  only  sufficient 
conditions  are  considered  which  however  are  the  most  use¬ 
ful  ones  for  applications.  In  [11],  independently  of  [14], 
the  method  based  on  approximation  theory,  of  functions  of 
a  real  variable,  was  presented.  The  underlying  ideas  ex¬ 
tend,  as  shown  here,  though  the  method  of  proof  of  [11] 
does  not  generalize.  The  vector  integration,  and  the 
bimeasure  theory  are  useful  in  this  extension. 

2.  As  the  above  discussion  indicates,  historically 
the  philosophy  of  sampling  theorms  for  processes  is  to 
analyze  the  behavior  of  the  spectral  function  where  it  is 
available.  However,  one  cannot  always  consider  processes 
having  spectral  functions  as  in  Section  1.  Then  this 
type  of  sampling  theory  becomes  meaningless.  Instead  one 
can  consider  some  approximations  from  a  different  point 
of  view.  For  instance  most  second  order  processes  admit 
their  covariance  representation,  called  "generalized 
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triangular  covariances,'*  extending  (20)  in  which  ]R  is 
replaced  by  a  more  complicated  set.  This  may  be  stated 
as  follows.  Let  T  be  a  subset  of  1R  (  *  1R  is  possible) 
and  r(  ,•)  :  TxT  “•  $  be  a  positive  definite  mapping.  Con- 
sider  a  space  Hq  c  t  ,  called  the  reproducing  kernel  in¬ 
ner  product  space:  f€Hn  iff  f  ■  £  cir(s.,-)  ,  c.€C  . 


If  also 


ict  space:  f€Hn  iff  f  -  £  c4r(s.,-)  ,  c.€C  . 

i-1 

m 

g«  E  d.r(-,t.)  €Hn  ,  then  introduce  the  inner  pro- 
j-1  J  J  u 

J  n  m 


duct  <f,g> 


n  m 

£  £  r(s^,t.)  .  This  is  well-defined 

i-1  j-1  1  J  1  2 

(r  product.  If  is  the  closure  of  H, 


and  is  an  inner  product.  If  »r  is  the  closure  of  Hq 
in  this  inner  product,  then  Wr  is  called  the  Arons zajn 
space .  This  is  separable  if  for  instance  r  satisfies  a 
smoothness  condition.  Let  (]R  ,8)  be  the  usual  Borelian 
line,  0  -  ]Rx  TL  ,  £  -  flSP(Z)  .  Then  the  following  re¬ 
sult  holds  : 

Proposition  5.1.  Let  r  :  TxT  *•  C  be  a  covariance 
function  such  that  the  associated  Aronszajn  space  is 

separable .  If  (C,£)  is  as  above,  then  there  exists  a 
Lebesgue-Stieltjes  a-finite  measure  v  on  £  and  a 
measurable  family  of  complex  functions  Ct(t,-)»  t€T] 
such  that 

r(s,t)  -  j,'l'(s,u))V(t,iu)v (duj)  ,  s,t€T  .  (34) 

n 


The  actual  structure  of  t's  and  v  as  well  as  the 
proof  of  this  result  are  given  in  ([15],  Sec.  6.2)  .  But 
the  t-functions  do  not  generally  have  any  of  the  proper¬ 
ties  of  the  g-functions  of  the  last  section.  While  v 
can  be  regarded  as  a  "generalized  spectral  measure"  of 
r  ,  it  is  hard  to  relate  these  to  those  of  the  process 
X  ,  as  in  the  preceding  theory.  This  is  why  the  consid¬ 
erations  there  were  given  to  a  subclass. 

3.  One  can  consider  nonperiodic  sampling  theorems 
also.  Let  X(t)  be  of  weakly  Cramer  class  relative  to 
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a  family  [ g(s , • ) ,s€]R}  so  that  (17)  holds.  Suppose 
that  g(-,A.),\€]R  ,  is  analytic  and  g^(s,*)  is 
strictly  Fx  -  integrable  for  each  s€]R  and  n^l  where 
Fx  is  the  spectral  measure  of  X(t)'s.  This  implies 
through  (15)  and  ([4],  Thm.  IV. 10. 8)  that  Cx(t),t€®}  is 
a  second  order  analytic  random  function  since  the  co- 
variance  rx(*,*)  *-s  infinitely  differentiable.  Using 

the  fact  that  an  analytic  function  is  uniquely  determ¬ 
ined  if  it  is  known  at  a  countable  sequence  of  points 
which  tend  to  a  limit  point,  one  can  deduce  the  sampling 
theorem  of  the  following  type  as  in  ([14],  p.  68):  If 
Ctn,nil}  <=  1R  is  an  infinite  bounded  set  of  distinct 
points .  and  X(tn)  is  known  at  each  “time"  t  ,  where 
the  g(s.-)-set  satisfies  the  smoothness  conditions  noted 
above,  then  the  samples  CX(tn),n*l}  also  determine  the 
process .  A  proof  of  this  statement  will  be  omitted  since 
it  can  be  constructed  from  the  above  remarks  easily. 

4.  It  is  possible,  in  many  cases,  to  put  con¬ 
ditions  on  the  covariance  function  rx  of  a  process  X 

such  that  it  admits  a  Mercer  type  series  expansion.  This 
in  turn  easily  implies  an  orthogonal  series  expansion  of 


X(t)  -  £  a(t)f.  ,  where  Cf„,n*l}  is  an  uncorrelated 

n  n  n  *  n 

ft  JL 

sequence  of  random  variables  each  with  mean  zero  and  unit 

variance.  The  partial  sums  of  the  series  can  be  used  as 

the  "sampling  sequences."  Here  the  problem  of  computing 

the  "coefficient  functions"  a„(*)  is  nontrivial,  and 

n 

this  approach  has  other  drawbacks .  We  therefore  do  not 
consider  this  set  in  the  general  format  of  the  sampling 
theory  of  random  processes,  which  is  based  on  the 
Kotel ' nikov -Shannon  type  series.  Such  expansions, 
however,  have  utility  for  other  problems. 

5.  Finally,  formulas  (1)  and  (3)  show,  in  case 
F  ,G  are  absolutely  continuous,  that  F'  and  G' 

A  A  A  A 
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are  Fourier  transforms  rx  of  rx  and  so  one  may  seek 
conditions  on  these  to  obtain  some  "sampling  theorems." 
These  are  very  special  assumptions  and  for  (4)  or  (7)  no 
such  assumption  is  meaningful  since  the  respective  inte¬ 
grals  are  not  in  Lebesgue's  sense.  From  all  these  consid¬ 
erations,  it  appears  that  the  theory  of  bimeasures  plays 
a  vital  part  for  processes  of  the  type  having  spectral 
functions  in  ]R  ,  i.e.,  for  the  classes  of  processes 
treated  in  this  paper. 
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